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Dunkel and Hilbert, “Consistent thermostatistics forbids negative absolute temperatures,” Na¬ 
ture Physics, 10 , 67 (2014), and Hilbert, Hanggi, and Dunkel, “Thermodynamic laws in isolated 
systems,” Phys. Rev. E 90 , 062116 (2014) have presented an unusual view of thermodynamics 
that sets aside several properties that have traditionally have been assumed to be true. Among 
other features, their results do not satisfy the postulates of thermodynamics originally proposed by 
Tisza and Callen. In their theory, differences in the temperatures of two objects cannot determine 
the direction of heat flow when they are brought into thermal contact. They deny that negative 
temperatures are possible. We disagree with most of their assertions, and we present arguments in 
favor of a more traditional interpretation of thermodynamics. We show explicitly that it is possible 
to deduce the thermodynamic entropy for a paramagnet along the lines of classical thermodynamics 
and that it agrees with Boltzmann entropy in equilibrium. A Carnot engine with efficiency larger 
than one is a matter of definition and is possible for inverted energy distributions, regardless of 
whether negative temperatures are used in the analysis. We elaborate on Penrose’s argument that 
an adiabatic and reversible process connecting systems with Hamiltonian H to —H is possible, thus 
negative temperatures logically must exist. We give a demonstration that the Boltzmann tempera¬ 
ture determines the direction of heat flow while Gibbs temperature does not, for sufficiently large 
systems. 


I. INTRODUCTION 

Compelling arguments have been presented for the 
thermodynamic concept of negative temperature, an ide¬ 
alization and abstraction for systems with bounded en¬ 
ergies [IHi- However, Dunkel and Hilbert (DH) Q and 
Hilbert, Hanggi, and Dunkel (HHD) Q have recently ar¬ 
gued that negative temperatures arise due to the use of 
the Boltzmann entropy, which they claim to be inconsis¬ 
tent. Instead, they suggest Boltzmann’s entropy should 
be replaced by one due to Gibbs. The Gibbs entropy is 
defined as the Boltzmann constant times the logarithm 
of the total phase space volume less than a given energy. 
Since the phase space volume is an increasing function of 
energy, the Gibbs entropy only allows for positive tem¬ 
peratures. 

For quantum systems with discrete energy levels, the 
Boltzmann entropy corresponds to the logarithm of the 
degeneracy of an energy eigenstate (or in a narrow energy 
interval), while the Gibbs entropy is obtained by count¬ 
ing all the states less than or equal to a given energy 
[j-Q. With this definition of entropy, temperature can¬ 
not be negative as entropy is a nondecreasing function 
of energy. While the differences between the predictions 
of the Gibbs and Boltzmann entropies are unmeasurable 
for macroscopic systems with monotonic energy densities 
(such as a system of harmonic oscillators), the differences 
are dramatic for systems with non-monotonic density of 
states. 

DH and HHD also applied their theory of thermody¬ 
namics to systems with very few degrees of freedom. We 
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do not believe that thermodynamics is applicable to sys¬ 
tems for which the relative fluctuations are large, so we 
will restrict our remarks to large systems. 

Objections to DH’s claims have been made by several 
authors [mi. In this paper, we expand on these discus¬ 
sion to emphasize that it is appropriate to include neg¬ 
ative temperature in thermodynamics, and to illustrate 
some incorrect predictions of Gibbs entropy. 

The organization of the paper is as follows: In Sec. [TTl 
we briefly comment on the formulation of thermodynam¬ 
ics and entropy. A consistency condition is discussed in 
Sec. mi and we point out that such a condition has no 
constraint to the Ising model. In Sec. HYl we discuss 
the entropy of a paramagnet. After that, in Sec. |Vl we 
discuss why an efficiency larger than one is possible for 
a Garnot engine for inverted energy distributions, and 
that they are well described by negative temperatures. 
We then discuss the properties of adiabatic invariance in 
classical (Sec. I VII) and quantum systems (Sec. IVIBI) and 
demonstrate that the number of states less than a given 
value of energy is not a true adiabatic invariant. We 
demonstrate with the examples of model systems that 
negative temperature does not lead to contradictions in 
Sec. lVHI and IVHlI In Sec.|TX]we criticize the application 
of thermodynamics to systems with only a single one de¬ 
gree of freedom. In Sec. E a two-level model calculation 
shows that Boltzmann temperature is decisively the cor¬ 
rect temperature since it predicts the direction of heat 
transfer and is consistent with the second law of thermo¬ 
dynamics. After briefly discussing ensemble equivalence 
(Sec. IxH) and the additivity of entropy (Sec. IXH|) . we 
discuss the concavity of the Gibbs entropy (Sec. IXHIl) 
and its violation of Gallen’s postulates (Sec. IXIVI) for 
negative temperature states. We discuss the thermody¬ 
namics formulated in Ref. H (Sec. IXV|) and considering 
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the nonequilibrium statistical mechanics of splitting and 
joining of two systems (Sec. IXVI|) . We remark on the 
non-monotonic dependence of temperature with energy 
for finite systems and why it disappears (Sec. IXVII|) for 
large systems (or in thermodynamic limit [l^l. We con¬ 
clude with some final remarks in Sec. IXVllIl and IXIXI 


II. THERMODYNAMICS AND ENTROPY 


Dunkel and Hilbert Q began with a statement that 
the positivity of absolute temperature is a key postulate 
of thermodynamics. DH cited Callen (postulate III, page 
28, 2nd edition, 0) that entropy ‘is a monotonically in¬ 
creasing function of the energy.’ They did not explain 
why they regard it as a key postulate. The only rea¬ 
son we know of is that monotonicity allows the equation 
S = S{E, V, N) to be inverted to give E = E{S, V, N), 
from which the usual thermodynamic potentials can be 
obtained by Legendre transforms. This is a matter of 
convenience, not principle, and Massieu functions can 
produce the same results through Legendre transforms 
of S' = S{E,V, N). Apparently, DH rejected most of 
Callen’s other postulates of thermodynamics. 

The axiomatic formulation of thermodynamics^such as 
that given by Giles [l^, or Lieb and Yngvason [T^, does 
not feature the concept of temperature until a very late 
stage. So the positivity of temperature is not at all a fun¬ 
damental axiom of thermodynamics. Even energy does 
not enter into the picture initially. What is fundamental 
in thermodynamics is the concept of irreversibility. This 
concept appears and is an emergent phenomenon only 
in the macroscopic world; as is well-known, there is no 
irreversibility in microscopic physical laws. 

Whether one follows the traditional approach to ther¬ 
modynamics or the postulatory approach of Gibbs, 
Tisza, and Callen, or the more precise axiomatic formu¬ 
lation in the post-modern era, they are all consistent and 
convergent to the same physical theory of thermodynam¬ 
ics. When we say “thermodynamics”, there should not be 
disagreement as what we mean by it. But since Hilbert, 
Hanggi, and Dunkel (HHD, @) proposal of a thermody¬ 
namics is substantially different from the usual formula¬ 
tion, we need to examine its legitimacy. 

It is possible to develop statistical mechanics in ex¬ 
actly the same way as in the traditional thermodynam¬ 
ics, where an empirical temperature occupies a promi¬ 
nent place in defining isothermal processes. With the 
help of the Carnot cycle, we can define absolute temper¬ 
ature, and thus, following Clausius, entropy. This chain 
of reasoning puts entropy at the last, so the dispute over 
which expression is the correct entropy can be, hopefully, 
resolved. We give some details with such an approach 
here. Of course, the final result is exactly the same as 
the standard textbook statistical mechanics with Boltz¬ 
mann entropy. 


A. Stability of thermodynamic systems 

DH and HHD have argued that negative temperature 
states are unstable or unphysical; any contact with a pos¬ 
itive temperature environment will collapse the system 
[2l[. There seems to be a misunderstanding of thermo¬ 
dynamic stability. Any thermal contact of any system 
with another system at a different temperature takes 
it through an irreversible process into a different equi¬ 
librium state. If a system at negative temperature is 
brought into contact with another system at negative 
temperature, the final equilibrium will be at an inter¬ 
mediate tempearature that is also negative. The states 
are stable if the entropy associated with the system is 
a concave function of energy. If a negative temperature 
system is in contact with a system of the same negative 
temperature, it will happily coexist. 


B. Consequences for the definition of entropy 

We choose a notation that is largely consistent with 
that of DH. The total number of states below energy E 
is 


niE) = ^ 1 . ( 1 ) 

Ej<E 


For simplicity, we’ll consider mostly quantum systems 
with a set of discrete energy eigen spectra, Ej, j = 1, 2, 
• • •. And uj{E)A = n{E) - n{E - A) « n'{E)A. The 
Gibbs (volume) entropy is Sq = fcBlnr2(A), and Boltz¬ 
mann, Sb = ks ln(a;(E)A). The small energy A is used 
to specify an energy range of microcanonical ensemble of 
the system. 

We define = dSc/dE and = dSn/dE. 

We had always thought that the difference between 
SB and So was so small for a macroscopic system that it 
would be impossible to detect, which would imply that 
the choice might be a matter of taste to some extent. This 
is true for systems of particles with unbounded energies. 
Now it appears that DH have (inadvertently) provided a 
demonstration that So is not tenable. 

In Refs, the definition of entropy, en¬ 

tropy of macroscopic observables, is based on the joint 
probability distribution for large, but finite systems. In 
this particular case, it is equivalent to what DH labelled 
as Sb, although the additive constant is expressed differ¬ 
ently than their kB In A. Therefore, by construction, the 
maximum of the sum of the entropies occurs at the max¬ 
imum probability of a subsystem energy after the two 
subsystems have come to thermal equilibrium. 

This means that - if they insist on taking the small 
differences seriously - the maximum of their sum of en¬ 
tropies occurs at a non-equilibrium value of the energy of 
the subsystems, see Sec. lXIV~Al If they were to give initial 
conditions such that the two subsystems started at the 
maximum of their total entropy, releasing the constraint 
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(allowing heat transfer), then splitting again would lower 
the entropy, in violation of the second law (T^ . 


III. CONSISTENT CONDITIONS FOR 
ENTROPY 


We would certainly agree with the importance of DH’s 
Eq.(4), but it would be more appropriate to write it as 


where 



ajdAj, (2) 


1 

T 



( 3 ) 


1 


T 


(—) 

J E,{Ak}k^3 


( 4 ) 


The volume V should be included in the Aj^s. It would 
not be an appropriate variable for most systems with 
bounded energy. 

For classical Hamiltonian systems, the argument that 
Tb ^ To seems unfounded because the difference is of the 
order of 1/N, such as for ideal gas, while fluctuations are 
of the order l/-\/]V. If fluctuations are negligible, which 
is usually assumed in thermodynamics, then Tb — Tq is 
negligible. 

The consistency issues have been addressed in the past. 
Boltzmann himself discussed it in what Boltzmann called 
‘heat theorems’, asking questions of consistency with 
thermodynamics (see appendix 9A1 of Gallavotti’s text¬ 
book see also the discussion in S.-K. Ma, Chap. 23 
[ 23 ). It is not essential that Sg satisfies the condition 
for all iV, but for none with Sb-, since thermodynamics is 
well-defined only in the limit N ^ 00 . And in that limit, 
it does satisfy (Frenkel and Warren [HI), so nothing is 
violated. 

A key feature of the consistent condition, Eq. (6) in 
DH which we write down again here. 


aj = T 


dS 


E 



( 5 ) 


which the authors do not seem to notice is that when it 
applies to, say, the one-dimensional (ID) ferromagnetic 
Ising model. 


N 

H — J ^ ^ (J7V-t-l — CTi, (7i — dzl^ (b) 

i=l 


thermodynamic variable, i.e., A = J. Then the consis¬ 
tency condition only produces an identity, E — {H), for 
any reasonable expression of S. This is because the S- 
dependence gets cancelled between T and dS/dJ, since 
S{E,J) = S{E/J). The consistency condition has no 
use to judge which entropy expression is correct, at least 
for the Ising chain. In Sec. IIVFI below, we also show that 
the consistent condition is violated for a paramagnet if 
Gibbs volume entropy is used. Extending the adiabatic 
invariant and consistency properties of Gibbs volume en¬ 
tropy, valid for classical Hamiltonian systems with con¬ 
tinuous energy spectra, to all systems, seems to us an 
over-generalization, and need further justification. 


IV. ENTROPY OF A PARAMAGNET FROM 
CLASSICAL THERMODYNAMICS 

Which of the alternative starting points of definitions 
for entropy is correct? We address this question in a 
different perspective. Instead of taking a postulatory ap¬ 
proach to the expression for entropy, we derive ib follow¬ 
ing the classical approach to thermodynamics [^. This 
consists of the following steps: 0) fundamental to sta¬ 
tistical mechanics is the equal-a-priori probability and 
microcanonical ensemble. This will be our basis in the 
following consideration. In order to reproduce thermody¬ 
namics from statistical mechanics, we work in the ther¬ 
modynamic limit (i.e., large system sizes). 1) Build an 
empirical thermometer to realize the zeroth law of ther¬ 
modynamics. 2) Use the thermometer to determine the 
equation of state and thus adiabatic and isothermal pro¬ 
cesses. 3) Build Carnot cycles to find the universal func¬ 
tion relating the empirical temperature to the Kelvin 
scale. 4) Define the entropy according to Clausius. This 
chain of reasoning puts entropy at the last as an output of 
the more mechanical arguments, instead of starting with 
the entropy postulates. As a by-product, the concept of 
negative temperature results naturally from the deriva¬ 
tive of entropy with respect to energy, if steps 1) to 4) 
are not erroneous. To do this in a very general setting is 
obviously difficult. Here we are modest, considering only 
the simplest possible model systems. In particular, we 
take a one-dimensional (ID) Ising model as our bath or 
thermometer, and a non-interaction paramagnet as the 
system (see also Frenkel and Warren, Ref. Ell). Our logi¬ 
cal conclusion is that the usual textbook entropy formula 
is sound and implies the existence of negative absolute 
temperature for systems with bounded energy. 


A. Equal a priori probability and microcanonical 
ensemble 


it just produces a “null statement”, as there is no A- 
variable to use to form the equation. The thermody¬ 
namic equation is simply dE = TdS. Alternatively, one 
can use the coupling J as one of the external control 


We assume that the dynamics is such that energy is 
conserved. The probability distribution function (for 
classical systems) or density matrices (for the quantum 
case) follows the Liouville or von Neumann equation. 
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However, our Ising model does not have an intrinsic dy¬ 
namics; we assume that the system follows some form 
of stochastic dynamics governed by a master equation 
(Penrose (Hi)- We do not need to explicitly specify the 
dynamics as we are not interested in the actual time- 
dependent processes, in other words, we work in the do¬ 
main of equilibrium statistical mechanics and quasi-static 
processes. The only thing that is required is that the 
system evolves in such a way that micro-states with the 
same energy (or other conserved quantities, e.g., mag¬ 
netization) will have the same probability, i.e., the mi- 
crocanonical assumption. Another point is that we will 
work in large size limit (i.e., thermodynamic limit). Sys¬ 
tems with few degrees of freedom in isolation belong to 
the regime of mechanics and cannot possibly behave like 
a thermodynamic system (e.g., cannot thermalize). This 
helps in simplification of our derivations. 


B. ID Ising model as a thermometer 

We consider a ID Ising chain with a periodic bound¬ 
ary condition without a magnetic field term, with the 
Hamiltonian function given by 

Nb 

Hb = -JY1 erf = ±1, ^Nb+1 = eef ■ (7) 

The super-/subscript B indicates the degrees of freedom 
of the bath (or thermometer) in contrast to the system 
without the sub- or superscripts. Since we work in micro- 
canonical ensemble, the (statistical mechanical) system is 
uniquely characterized by the total energy Eb and num¬ 
ber of spin Nb- Now we define an empirical temperature 
6 = {(Jicri)- The average (• • •) is with respect to the 
microcanonical ensemble. It is clear that Eb = —JNbO- 
We note that — 1 < 0 < 1, so our thermometer readings 
are real numbers from — I to 1, with negative values corre¬ 
sponding to the usual negative temperature. As we’ll see 
later, this temperature scale 0 is essentially /3 = l/{kBT) 
mapped to a bounded interval. Unlike the ideal gas ther¬ 
mometer, our Ising thermometer can measure both pos¬ 
itive as well as negative temperatures. 


C. Paramagnet working system 


of the equation of state (magnetization) is M = —E/h. 
In a microcanonical ensemble energy does not fluctuate. 
By the first law of thermodynamics, dE = SQ -I- SW, 
we can identify the heat and work as SQ = —hdM and 
SW = —Mdh, respectively. The work is related to the 
part of internal energy changeable by the control param¬ 
eter h. From the above, we note that adiabatic lines are 
very simple, given by M = const. - horizontal lines in an 
M v.s. h diagram (see Sec. I VI Bl for further justification). 
However, the isothermal curves are more difficult to spec¬ 
ify, as we do not have a real equation of state relating to 
the (empirical) temperature yet. 


D. Measuring the empirical temperature of the 
system 


To find the empirical temperature of the paramagnetic 
system, we take initially two separate systems of the ther¬ 
mometer, characterized by the total energy Eb, and the 
system, characterized by E and h (the sizes Nb and N 
are also parameters, but they are considered as fixed con¬ 
stants). We then combine them into a new system with 
the Hamiltonian Htot = Hb + H. As there is no ex¬ 
plicit interaction term between the two subsystems in 
the Hamiltonian and the dynamics is such that it makes 
Eltot microcanonical, the effect of combining them is to 
make each subsystem no longer in microcanonical distri¬ 
bution but new marginal distributions dictated by the 
overall microcanical distribution. We now ask what the 
expectation value {cti Htot=EB+E is. If this value is 
the same as before making the contact, 9, then we say 
that the system is at the empirical temperature 9. This 
defines the self-consistent condition for the temperature 
of the paramagnetic system 


1 Nb 

-Y 

Ir, ^ 




Nb ^ 


cr,- a, 


i+l 


i=l 


Htot{'y^,'y)=EB+E 


(9) 


This is an equation for 9 as the right-hand side also con¬ 
tains 9 due to Eb = —JNb9. The result will depend on 
E and h in the constraints. The equation can be made 
more explicit as 


Eb = (eB(cr^)) 


X;,eB(i)n^(z)n(V-) 
Ez nB{i)n{N_) 


( 10 ) 


We build a Carnot engine made of an Ising paramag¬ 
net, given by the Hamiltonian 

N 

H = -h'^aj, crj=±l. (8) 

i=i 

Let Ab|_ and V_ be the number of spins with plus 
and minus signs, respectively, then the energy is if = 
—hN+ -I- hN- = —hM, and the total magnetization is 
M = Ab|_ — N-. A thermodynamic state is uniquely spec¬ 
ified by the energy E and the magnetic field h, while one 


where the ‘density of states’ (number of microscopic 
states at energy 65(4) = —JNb + 2Ji, i even) of the 
ID Ising is 

We assume Nb even for simplicity, i denotes the num¬ 
ber of plus-minus boundaries in a ID Ising configuration. 
Similarly, the density of states of the paramagnet is 

niN.) = niN+) = 


N++N_= N, (12) 
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M 



FIG. 1. Carnot cycle using paramagnet as substance. 


and Nj^ = [N — EIK)I2, and iV_ = (N + E/h)/2. i and 
N- are related by energy conservation 


eB{i)-{N-2N_)h = EB+E. (13) 

Equation (HQD would be difficult to evaluation in gen¬ 
eral but great simplification is available in the thermo¬ 
dynamic limit, i.e., Nb and N are large (but still finite 
quantities). Then the summation is dominated by the 
largest weight, n^n. We find the value i for which the 
weight is a maximum. Although i and or iV_ are 
integers, in the large size limit, we can treat them as 
real numbers. Using the Stirling approximation, Inj! = 
j Inj—j, for j sufficiently large, and obtaining the deriva¬ 
tive of In(n^n) with respect to i and setting it to 0, we 
obtain the condition In {i/{NB — i)) = (J/h) ln(A^_/iV+). 
In deriving this, we have assumed self-consistency on the 
right-hand side, i.e., Eb = — JNbO, 0 = 1 — 2i/NB- This 
optimal value of i is essentially our temperature of the 
system. Instead of using integers i and iV+, A^_, we can 
replace them by more physical quantities, with i hy 0, 
and N^, iV_ by M and iV, we find 



1 + 0 
1-0 


In 


N + M 
N-M 


(14) 


or 


E. Carnot cycle 


With the empirical temperature of the system well- 
defined, we can construct Carnot cycles. An example is 
given in Figure [TJ The two adiabatic curves are charac¬ 
terized by Ml and M 2 as horizontal lines. The isothermal 
curves are labeled by 0i and O 2 (or equivalently Pi and 
p 2 )- They are given by the equation of state for the para¬ 
magnet as 

M = N tanh(ph). (16) 


An important point is that these family of isothermal 
curves are identical no matter what empirical tempera¬ 
ture scale one uses, thus independent of the temperature 
measuring devices. Hence, the concept of ‘temperature’ 
is just a one-parameter family of real numbers labeling 
these curves. Positivity of the temperature is not re¬ 
quired. As in the usual construction of the Kelvin tem¬ 
perature scale, we compute the heat absorbed at the high 
temperature, Qi at di, and heat released at low temper¬ 
ature, Q 2 at O 2 with the total work, IT > 0, done by the 
system as the area of the loop running clockwise on the 
cycle. High and low temperatures are defined according 
to second law of thermodynamics (not the actually values 
of the parameter 0) - heat flows from high temperature 
to low temperature if there is no external intervention. 
Then, 


Q 2 f{02) 
Qi fidi)' 


(17) 


Our job is to find the function /, that depends on our 
choice of the empirical temperatures, but if we define 
T = constf{0), then this new temperature scale, T, the 
Kelvin scale, clearly is independent of the makeup of 
the thermometer and is universal in the sense that all 
Carnot cycles have exactly the same efficiency formula 
77 = W/Qi = 1 — T 2 /T 1 if temperatures are the same on 
the Kelvin scale. Thus, the Kelvin scale is a privileged 
one over the empirical ones. We now work out explicitly 
this function /. Using the formula for heat, we have, 
with the equation of state. 


/3/i= jtanh ^(0)=tanh ^(M/iV), (15) 

OT M = N tanh{ph) with 0 = tanh(,5J). Reader famil¬ 
iar with the canonical treatment of ID Ising model and 
paramagnet will immediately recognize that these results 
are identical to the usual formulas in canonical ensemble 
if we identify P with the usual P = l/(fcsT) (We do 
not use canonical ensemble because that would presume 
ensemble equivalence and defeat the purpose of introduc¬ 
ing empirical temperature). Here /3 is a derived concept, 
characterizing, in an alternative way, the temperature of 
the system or bath. This simple picture emerges only if 
thermodynamic limit is taken. For notational simplicity, 
we’ll drop the tilde below but P should be understood as 
constructed above. 


f-Ma 


Qi — — 


I Ml 


hdM = —hM 


N 


M 2 rM2 

+ I 

Ml Jmi 

cosh(/3ih2) 


Mdh 


= -/ 12 M 2 -I- hiMi + ^ In , ^ 

Pi cosli(pi/iij 

= Ti[S{M2)-S{Mi)], 


(18) 


where we define Ti = 1/(kBPi), which is just the conven¬ 
tional Kelvin scale, fixing an arbitrary constant relating 
our empirical temperature 0 to T, and S' is a function 
defined by 


S(M) = —kBPhM + kBN\ncosh{Ph) + const 


= -kBN 


1 -f M/N , 1 -h M/N 

-^-In--- 


1 - M/N 1 - M/N 

-T -J-H-r - 


( 19 ) 
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To obtain the second line, we have used again the equa¬ 
tion of state of the system. We also dropped an arbitrary 
integration constant. We recognize that this is nothing 
but the usual entropy of mixing formula. An important 
observation is that S does not depend on h explicitly 
and only on M, which is consistent with the fact that 
the adiabatic lines are M = const. This M-only depen¬ 
dence also satisfies the consistent condition, Eq. ®. A 
similar calculation can be carried out, and one finds 


does not become dense even for large sizes. If this for¬ 
mula is used for entropy, we can not recover the third law 
of thermodynamics, as even in the ground state W = 1, 
S still depends on the magnetic field h logarithmically. 
Thus, the prediction by Campisi that the thermodynamic 
magnetization calculated by 


dS/dh E keT 
dS/dE ~~~h /T 


(25) 


Q2 = T2(s{M2)-S{M^)), 

thus 

Qi Ti 

And the desired / function is 

T = f{e) = l/{kBp) = J/(fcBtanh-i(0)). 


( 20 ) 


( 21 ) 


( 22 ) 


The last step in this argument is to define entropy ac¬ 
cording to Clausius, i.e.. 


dS = (23) 

or S' = — hdM/T + const. As the integrand is a 
total differential, exactly what process or which path to 
use is immaterial — we get exactly the same expression 
(e.g., integrating over isothermal curve). Of course, the 
result is just the standard entropy formula for paramag- 
net, Eq. (HU). By differentiating with respect to E, fixing 
h (since we have the fundamental thermodynamic rela¬ 
tion dE = TdS — Mdh), we can see that temperature 
can take both positive as well as negative values (when 
E = -hM > 0). 


F. Discussion 


has a singularity (the last term above) is simply due to 
a wrong application of the Boltzmann principle. We also 
note that W, thus Ss, is an even function of the magne¬ 
tization M only, and M is an adiabatic invariant. But 

N\ 

" -h<E m-m)/2]l[{N + m)/2]l 
= n+{M)9{h)+ n-{M)e{-h) (26) 

(m = —hN, —h{N—2), • • •, hN] 6{h) Heaviside step func¬ 
tion, and = 2^) depends on M and h separately 

and experiences a discontinuous jump when h changes 
sign. Moreover, uj{E,h) = dn{E,h)/dE is not an inte¬ 
grating factor, since 

dfl = ojSQ + (H'*" — Q~)S{h)dh, (27) 

where the heat is SQ = —hdM. This prevents H being 
an adiabatic invariant [l^ . The appearance of the sec¬ 
ond term in Eq. ([27)l also causes the consistent condition, 
Eq.([5]) with A = h, violated. 

If we reflect back on our derivation, it is clear we must 
have a negative temperature scale of an intensive quan¬ 
tity, since we have decided to measure the temperature, 
be it positive or negative, by a local property. Boltz¬ 
mann’s critical insight of connecting thermodynamic en¬ 
tropy with probability and chance is throwing out of win¬ 
dow if Gibbs volume entropy is adopted. 


Boltzmann’s original definition of entropy is based on 
probability. Since each state is equally likely in a mi- 
crocanonical ensemble, we have Sb = fcslnlT, where 
W = 1/P is the number of microstates consistent with 
the given constraint, and P is the probability of each 
micro-state. For our magnetic system, 


V. CARNOT EFFICIENCY GREATER THAN 1 

The efficiency of a Carnot cycle when negative tem¬ 
perature baths are possible is well analyzed by Ramsey, 
Frenkel and Warren, see also Ref. HO- If we define the 
Carnot efficiency in the usual way. 


W = 


N! 

[{N + M)/2]\[(N - M)/2]\' 


(24) 


V = 


W 

Qh 


= 1 - 


Ic 

Th' 


(28) 


After using the Stirling approximation for the factorial 
function, valid for large N, we obtained the standard 
entropy mixing formula. 

Campisi in Ref. defined a Boltzmann entropy as 
S{E,h) = kBln.^W/h) + const. This is not correct, ac¬ 
cording to most textbooks (see Nagle, [2^, who cited 
many popular statistical mechanics books). Replacing 
the number of states by the density of states is simply 
not possible as for the Ising model the energy spectrum 


where subcript El means ‘hot’ and C ‘cold’, the efficiency 
r] does get values larger than one. As explained in Ref. fill , 
this is just a matter of definition. 

In Figure[2l we illustration what is possible, what is not 
possible, if Clausius’s second law need to be obeyed, i.e., 
it is not possible for heat flowing from cold bath to hot 
bath spontaneously without any other effect. This is the 
only condition that can show very logically certain pro¬ 
cesses are not possible. Alternatively and equivalently. 
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(|) = -1/T, 


Q. 

0 

A 



1 Qc=Q„ 



Th<0 
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W>0 
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H 
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1 Qc>o 1 

1 Qc-'O 
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T >0 

T >0 

c 

c 

C 

(d) 

(e) 

(I) 


FIG. 2. Various Carnot cycle configurations with positive and 
negative temperatures. 


we can argue that the total entropy of the combined sys¬ 
tem and the baths cannot decrease. Let us use the fol¬ 
lowing sign convention: if the engine performs work to 
the environment, W > 0; if the engine absorbs heat from 
high temperature source, Qh > 0; and if it releases heat, 
Qc > 0. energy conservation requires Qh = Qc + W. 
Then the entropy increase from the hot bath is ASh = 
—Qh/Th, and from cold bath ASc = Qc/Tc- The sys¬ 
tem/engine returns to its starting point and does not in- 
curr entropy change. These equations are valid for both 
positive and negative Boltzmann temperatures. Then 
ASh + ASc > 0 for adiabatic processes. For the case 
of Fig. ma), Qh = Qc, we find the total entropy change 
need to be (l/Jc - 1/Th)Qh = {(t^H - 4 ‘c)Qh > 0, here 
we define 4> = — 1/T. If we use (j) as the temperature 
scale, then the hotness or coldness corresponds to the al¬ 
gebraic value (j) being large or small. Since we assume 
Qh > 0, we always need 4>h > 4>C, he., heat flows from 
hot to cold bath naturally. 

We can convert work to heat with 100 per cent effi¬ 
ciency for positive temperature bath (Fig. HKb)) but the 
reverse process is forbidden by thermodynamics since 
that corresponds to a decrease in entropy, ASh = 
—Qh/Th, if Qh > 0. However, if Th < 0, exactly 
the opposite is true (see Fig. HKc)). This last case in¬ 
deed shows that if a negative temperature bath does exist 
with infinite heat capacity, then a perpetual machine of 
the second kind is possible. But it is not possible to have 
a sustained negative temperature bath experimentally. 

Figure [2](d) shows the normal case of positive temper¬ 
ature baths with the efficiency bounded by 0 < ry < 1, 
since one must release heat, Qc > 0, in order to make 


sure the total entropy does not decrease. If bath tem¬ 
peratures are opposite, case (f), we can use both baths 
to do work, given an efficiency larger than one, if we still 
define efficiency as W/Qh- The case (e) is a situation 
that is allowed but is not a reversible process. 


VI. ADIABATIC INVARIANCE 


Since a strong point in promotingthe Gibbs volume en¬ 
tropy is its adiabatic invariance Sim, let us try to un¬ 
derstand what is adiabatic invariant. S.-K. Ma, Chap 23 
is helpful [ 23 . In an adiabatic process we change model 
parameters very slowly so that the system is always in 
equilibrium - the important statement is we change ac¬ 
cording to 


dE = (^^'^dL, (29) 

using Ma’s notation. This gives the adiabatic curves in 
model parameter space, (E,L). The average is over mi- 
crocanonical ensemble. He proved the adiabatic theorem 
using i5-function notation and summing over s notation 
which is understandable., i.e., (set ks = 1) 

S{E,L) = lnCl, Cl{E,L) = E 0{E-H{s,L)) (30) 

S 

is a constant if dE = (dH/dL) dL. 

Consider the standard microcanonical ensemble for 
classical system defined by the probability density in 
phase space as p = const if E < H < E + A and 0 
otherwise, as usual, but keep A a finite quantity. And 
define 


n{E) = [ dr. (31) 

Jh<e 

dr is the phase space volume element for classical system. 
The question is, if dE and dL are related adiabatically 
as in Eq. (l29l) . where the average (• • •) means over p, is 
Sb = in(ri{E -I- A) — H(E)) a constant? 


A. Simple Harmonic Oscillator Example 

Take 

H=^p^ + (32) 


then 


n{E) = dpdq = area of elli 


ellipse = (33) 


Thus, 


Sc 


In rt{E) = In 


2ttE 


(34) 


OJ 


















and 


E 


M 


SB = \n(n{E + l:\)-n{E)^=\n^^. (35) 

We can already see trouble here, as Sb does not depend 
on E. The differentials are 


and 


d5G = — 


du) 

UJ 


dSB 


duj 

UJ 


(36) 


(37) 


The adiabatic condition means, for the oscillator with 
a varying frequency and energy (work done by varying 
frequency equals to the energy increase). 


dE = 



(38) 


We need to compute the ensemble average explicitly, 
which is 


^ ^ I list quadrad^g^P^g" 

duj / A™ n{E + A) - n{E) 

_ E 

UJ 


(39) 


If we maintain a finite A, the expression is complicated, 
but taking the limit makes it very simple. This also 
means for the proof of adiabatic invariance, we really 
need A —?> 0 limit. Now one sees that dE = {E/uj)duj, so 
Sg is an adiabatic invariant, while Sb is not. 

This adiabaticity is closely connected to the ‘heat the¬ 
orem’ or ‘orthodicity’ as discussed in Gallavotti’s book 
[^ . Chap. 2. The two are just slight reformulate of the 
same question. Gallavotti explicitly stated that in canon¬ 
ical ensemble one does not need to take N to infinite, but 
one does need thermodynamic limit in micro-canonical 
ensemble (page 63-65). 

Although entropy must be an adiabatic invariant, due 
to Clausius equation dS = 5Q/T, there is no reason to 
believe that this is the only property of entropy. Adia¬ 
batic invariants do exist for small mechanical systems, in 
the sense demonstrated above, but these systems do not 
obey zero-th law of thermodynamics. 


B. Adiabatic invariance in quantum systems, 
Penrose’s counter-argument 

In quantum mechanics, one can prove an adiabatic the¬ 
orem which says if one changes the system very slowly 
through some model parameters, then if the system is 
in a pure quantum eigenstate, it will stay in this state. 
Thus, when control parameters change, if energy changes 
following the instantaneous eigenvalue of the system, it is 
an adiabatic change. This purely mechanical adiabaticity 



FIG. 3. Adiabatic change in a single spin paramagnet. (a) 
The energy eigenvalues of the -|- and — states with magnetic 
field h\ (b) and associated magnetization eigenvalues. 


coincides with thermodynamic adiabaticity, i.e., no heat 
transfer. 

Penrose [ij gives a counter-example showing that the 
total number of states Si equal to or smaller than a given 
energy eigenvalue E^ is not a true adiabatic invariant. 
The reason is in fac t q uite simple, if there is another 
energy level crossing |32| the current energy En which we 
focus on, the number of energy levels Em < En changes 
for fixed n. 

Gonsider a paramagnet Hamiltonian viewed as quan¬ 
tum operator. 


N 

H = -hM = -hJ2^i^ ( 40 ) 

i=l 

where df is the z-component of Pauli matrices. Since 
df commutes with iJ, the z component of the spin 
is a constant of motion from the Heisenberg equation, 
iUdaf /dt = [af,H], for any time dependence of h —>• h{t). 
In Fig.|3]we demonstrate the situation for a single spin. If 
we stay in the ground state when h < 0, we have no other 
states below it, so H = 1. As we cross h = 0 to the posi¬ 
tive field region, SI jumps discontinuously to 2. Thus it is 
not an adiabatic invariant. On the other hand, the mag¬ 
netization M as well as counting of levels determined by 
M are (quantum-mechanical) adiabatic invariants. The 
fact that the total magnetization is an adiabatic invari¬ 
ant is fully consistent with earlier discussion in Sec. II V Cl 
of the Carnot cycle of paramagnet. 

One might suspect that a transition occurs from ‘—’ 
state to ‘-I-’ state if one goes from negative h to positive 
h slowly, such as in the Landau-Zener problem. But since 
there is no couplings between up and down spin states, 
this does not happen. If the system is in a pure quantum 
eigen state \4>n) of M, its dynamic evolution is a triv¬ 
ial phase change, exp (a M„ J h{t')dt')\4>n{^))- Since the 
Hamiltonian is diagonal in the representation when M is 
diagonal, it cannot make a transition to another state. 
One can solve the von Neumann equation exactly, and 
finds that the density matrix evolves according to 

Pmuit) = (41) 
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in the representation for which M is diagonal. Again we 
find that the diagonal part of the density matrix does not 
depend on time, and off-diagonals are oscillatory. This 
dynamic evolution of the density matrix tells us that if 
the system is initially in a microcanonical ensemble at 
h < 0, it cannot change into a new and different micro- 
canonical ensemble at h = 0 occupying all micro-states 
with equal probability. 

It is clear if we start with a microcanonical ensemble 
at {—E, —h), we can evolve the system to {E, h) dynam¬ 
ically. But is this an adiabatic process? To answer this 
question we need to ask what is heat and what is work, 
in such a driven process when h(t) varies for an initially 
equilibrium density matrix p. The internal energy of the 
system \s E = Tr(i7/3), the differential is 

dE = Ti{Hdp) - Tr{Mp)dh 

= 5Q- Mdh. (42) 

We interpret the first term associated with distribution 
change as heat and second term work. If we say that 
the change of density matrix is solely from the von Neu¬ 
mann dynamics, dp oc [E[,p], then the first term is al¬ 
ways 0. A correct interpretation of change must be 
from re-equilibration of the system at the end of the dy¬ 
namic change. Since the system is already in equilibrium 
as given by the microcanonical ensemble (except at the 
point E = h — 0), there is no need to reequilibrate, and 
we find that the heat SQ is always 0. Then the adiabatic 
curves are given by dE = —Mdh [s^. 

Penrose used a symmetry argument to show negative 
temperature must exist in such systems. First of all, 
the thermodynamic entropy S' is a state function. For a 
paramagnet, a unique thermodynamic state is specified 
by E and h, we have S = S{E,h). Since M = —E/h 
and M is an adiabatic invariant, it means the adiabatic 
curves are given hy E/h = const in the state space. In 
particular, for each pair (A, h), the state {—E, —h) is on 
the same adiabatic curve and can be reached from each 
other adiabatically and reversibly, so entropy must be the 
same, 

S{E,h) = Si-E,-h). (43) 

Taking the derivative with respect to E, one find 


T{E,h) T{-E,-hy ^ ’ 

i.e., the temperatures of two thermodynamic states are 
related by an opposite sign. 

The above consideration is a powerful one and very 
general, and certainly not limited to a simple paramag¬ 
net. Given any arbitrary quantum Hamiltonian El, with 
the only requirement that it has discrete eigen spectrum, 
we can construct a family of Hamiltonians, El\ = XH. 
We see that from Eq. that we can connect 17+ = El 
to = —H adiabatically, with an arbitrary process 
X{t) that varies from -|-1 to —1. This is true for any diag¬ 
onal initial density matrix p, since the diagonal elements 


do not evolve. Then we must have 

S+{E) = S.{-E). (45) 

This equation implies if we have a positive temperature 
for a system with Hamiltonian H at energy E = Tr(/H7), 
there must exist another system with Hamiltonian —H 
with a negative temperature at —E. If the spectrum of H 
has inversion symmetry, then both positive and negative 
temperature can exist in the same system, such as the 
Ising model. 

The equality of entropies, Eq. (HSl) . and the symme¬ 
try argument are presented by Schneider et al Q, using 
canonical distribution and von Neumann entropy expres¬ 
sion. But as we can see an explicit ensemble and entropy 
definition are not needed for the argument. 

VII. THERMAL EQUILIBRIUM OF AN ISING 
MODEL 

Consider a two-dimensional Ising model, which has a 
bounded spectrum. For energies E > 0, Tb < 0, but 
DH claim that the correct thermodynamic temperature 
is To > 0. 

Consider the following two experiments: 

A. Two Ising models with negative temperatures 

If 0 > Tbp > Tb ,2 when the systems are isolated from 
each other, the temperatures will change when they are 
brought into thermal contact. After coming to a new 
equilibrium, we will have 0 > Tb,i > Tp > Tbp- 

If we compare this to an experiment with the same two 
systems at |Tb+| and |7 b, 2|) we can see from symmetry 
that the new final equilibrium temperature will be |7 f|. 

No paradoxes occur. 

B. An Ising model and simple harmonic oscillators 
(SHO) 

Now consider an Ising model at Tb,i < 0 and a set 
of quantum simple harmonic oscillators. The system of 
SHO’s must have Tsho > 0. For simplicity, let hw = 2J. 
This would make it easy to simulate the model. 

If Sb is correct, the temperature of the Ising system 
will become positive (higher (3j > 0) if the two systems 
are brought into thermal contact, so that they can ex¬ 
change energy. At the same time, /3 sho would decrease 
(higher temperature). 

DH claim that the true thermodynamic temperature of 
the Ising model is Toj > 0. Test their claim by setting 
the temperature of the SHO’s to Tsho = Top 

If DH are correct, the Ising system and the SHO’s are 
at the same temperature, so they should remain in equi¬ 
librium. This is not going to happen. It is both obvious 
and can be checked by a simple simulation. 
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VIII. AN INTERESTING TOY MODEL 


It has occurred to us that we have available a large 
set of bounded energy models. In Monte Carlo (MC) 
simulations, it is standard to exclude the momenta, since 
they can be integrated out exactly. 

Consider a gas with only configurational degrees of 
freedom. 


H = '^V{fj -fk), (46) 

j>k 

where 

V{r) = Xexp[-\f\y{2a^)], (47) 

and X and cr are constants. 

For low positive temperature Tb (large /3 b), the par¬ 
ticles will form a crystal. 

For T = oo, it will be an ideal gas. 

For large \Tb\, with Tb < 0, the particles will lie pref¬ 
erentially on top of each other. This is a state that cannot 
be realized for positive temperature, although DH claim 
that it should have a positive thermodynamic tempera¬ 
ture Ta^r- 

Now prepare the momentum variables in an equilib¬ 
rium state with temperature Tg,p = According to 

DH, allowing interactions between the momenta and po¬ 
sitions should not disturb equilibrium since the kinetic 
and potential degrees of freedom are already at the same 
temperature, and therefore in thermal equilibrium. 

It is obvious that the DH claim is wrong, but it would 
also be easy to simulate. 


IX. ONE DEGREE OF FREEDOM ISOLATED 
SYSTEM, OR SMALL SYSTEMS 

DH are in trouble when they discuss small systems, 
especially a single-particle system in one dimension. 


A. Two small classical systems in equilibrium 

Consider two such systems, each of which is a ID 
single-particle ideal gas, in thermal equilibrium with each 
other, but isolated from the rest of the world. The prob¬ 
ability distribution of the energy Ei of the first system 
is 


P{Ei) 


1 

'^\/Ei{Et — El) 


(48) 


This has divergent maxima at Ai = 0 and Ei = Et- To 
demand equipartition seems strange. 


S/(Mb) 



FIG. 4. The entropy So according to DH for harmonic 
oscillators with A = 1, 2, 5, 20, 80, and oo (from bot¬ 
tom to top). The limiting curve is given by S/(Afcfl) = 
(1 + n) ln(l -I- n) — nlnn, where n = E/{Nhv) — 1/2. 


B. Specific heat of a quantum SHO 

If we’ve read their paper correctly, DH claim that the 
specific heat of a d = I quantum SHO is C = fcs. [Three 
equations after their Eq.(IO), but without a number.] 
This claim is bizarre. It would be true for a classical 
SHO, but all quantum systems must satisfy the third 
law, which requires that C —>■ 0 as T —>■ 0. The correct 
expression can be found in any textbook. 

But this is exactly what the oscillator example shows, 
given a dubious prediction that the quantum oscillator 
has temperature, 


kBTc = ^EE. (49) 

The derivation of this result is questionable [s^. Using 
their definition of Vl{E) = Tr{6*(i3 — H)}, the function is 
a series of steps, equally spaced both in the independent 
variable E as well as the dependent variable H. Taking 
the logarithm to get Sg{E) = fc_BlnD(i3) also results in 
steps, see Fig.m Since the step function is a constant for 
all E except for a set of measure 0 which are the eigen- 
spectrum of the oscillator, the derivatives are 0 almost 
everywhere. Thus the temperature Tg is infinite, almost 
everywhere, just like when the Boltzmann entropy is ap¬ 
plied. In passing we also note that Sg{E) violated part 
of Callen’s postulate HI, as it is not a ‘continuous and 
differentiable’ function. 

To get out of this mess, one has to consider systems 
with N = I,2,3,---, oscillators in the macrocanonical 
ensemble, not just iV = 1. One plots S/NUb vs E/N, 
as in Fig. 0) On this scale, the steps become smaller 
and smaller as N becomes larger and larger, and the 
curves become smoother and smoother. In the N ^ oo 























limit, the limiting curve is a continuous function, and 
derivatives start to make sense. That is, temperature 
only make sense in the thermodynamic limit. 


X. RANDOM REMARKS ON So AND To 

Contrary to the authors’ claims, it is Sg and Tq that 
is inconsistent with thermodynamics. Firstly, let us con¬ 
sider a thought experiment with the harmonic oscillator. 
We can weakly couple it with a heat bath of macroscopic 
in size, then it is clear the oscillator will be in a mixed 
state described by the canonical distribution. Now we 
reduce the temperature T of the bath to zero. The os¬ 
cillator will be cooled down to a temperature of absolute 
zero and stays in its ground state. Suppose now we turn 
off the coupling between the oscillator and the bath, then 
there is good reason to believe that the oscillator will still 
be in ground state if we turn off the coupling very slowly 
(quantum adiabatic theorem). Since the system is now 
isolated and the state is in n = 0, it is in a microcanon- 
ical ensemble with E = hi/12. According to Eq. (HHl) . 
then, the temperature of the oscillator becomes hv/kB- 
It appears then, by a mere change of the mind of the ex¬ 
perimentalist that the system was in canonical ensemble 
and now in a microcanoical ensemble, the temperature of 
the oscillator has been changed dramatically. The experi¬ 
mentalist can do the single oscillator experiment with CO 
molecule which has a vibrational frequency of 2170 cm“^. 
Then the associated temperature is Tq = 3122 K. The 
temperature of the molecule has jumped from 0 K to a 
thousand kelvin just by changing the point of view of his 
system. One could argue that we are talking about two 
different temperatures, Tb and Tq. But thermodynamics 
has only one kind of temperature. 

Another example, consider putting a hydrogen atom in 
a box, in its ground state it will be extremely hot with a 
Tg of order 10® K, while it is cooler in the excited states. 
Another excellent example is given by contacting a finite 
spin chain at (the traditional) negative T with an ideal 
gas, as discussed by Frenkel and Warren [HI- A 3rd ex¬ 
ample is that heat flows from cold to hot, according to 
the definition of Tg (see Vilar and Rubi, Ref. M)- Heat 
flow from hot to cold naturally is one form (Clausius) of a 
statement of the second law of thermodynamics. If this is 
not obeyed, it simply means that the definition or quan¬ 
titative measure of the hotness or coldness is wrong, or 
perhaps thermodynamics cannot apply for such systems. 
We also observe that heat flowing from hot to cold is an 
immediate consequence of the Callen’s second and third 
postulates. This is discussed in Callen’s book. Sec. 2-4 
and 2-5. It is clear these discussions apply equally well 
when temperature is negative. 

In HHD (Ref. H) it has been argued forcefully that nei¬ 
ther Gibbs temperature nor Boltzmann temperature can 
determine the direction of heat flow. This is certainly 
true for tiny systems as several examples show, such as 
that indicated by Fig. 7 in Ref. d. However, as soon as 



FIG. 5. Continuous energy two-level model. The lines of en¬ 
ergy per particle Ei/Ni vs. E2/N2 of two subsystems deter¬ 
mined by equality of Boltzmann temperatures, labelled Tb, 
and equality of Gibbs temperatures, labelled Tq, as well as 
the lines determined by average energies of the combined sys¬ 
tems (lines of zero heat transfer), labelled OQ, with Ai = 1, 
10, 100, and N 2 = 2Ni. 

the sizes of the systems become larger, we see clearly dis¬ 
tinguished role that Boltzmann temperature can play to 
determine the direction of heat flow while Gibbs temper¬ 
ature can not, for systems with bounded energy spectra. 
In Fig. [SI we present a similar plot to the figure 7 in Ref.|^ 
but with one additional parameter, the size Nj, j = 1, 
2. Here we consider a two-level system with ‘continuous 
energy’ such that the Boltzmann entropy is given by (set 
kB = 1 ) 

Sf = N, In N, - E, In E, - {N, - E ,) ln(7V, -E,), (50) 

with 0 < Ej < Nj, j = 1,2. Thus, the density of 
states is given by ujj = exp(S'^), and the integrated 

one fl{Ej,Nj) = uij{E')dE'. The lines marked OQ 
are the lines with no energy exchange on average if sys¬ 
tem 1 and 2, having energies Ei, E2 with total energy 
El + E 2 fixed, are combined and allowed to exchange 
energy. The OQ lines approach rapidly the line deter¬ 
mined by the equality of the Boltzmann temperatures, 
Ti{Ei,Ni) = T 2 {E 2 ,N 2 ) (which is given on this plot as 
a universal curve Ei/Ni = A 2 /A 2 )). The OQ lines do 
not approach the lines determined by equality of Gibbs 
temperatures in the region when the Boltzmann temper¬ 
atures are negative. Thus, thermodynamics applicable 
only to large systems is not “dogmatic”, but is really 
forced upon us, as small systems do not obey thermody¬ 
namic laws. 

The use of Gibbs entropy and temperature gives a 
meaningless result in the traditional negative tempera¬ 
ture thermodynamic states, e.g., take a ID Ising chain 
in a microcanonical ensemble. Then, according to DH, 
Sg/N = fcBln2, and Tg = 00 , in the thermodynamic 
limit, for all E > 0; the thermodynamic heat is then 
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TdS = oo-O which does not seem to be a useful concept. 

We can elaborate a little more for the last point. 
Take two segments of sufficiently long ferromagnetic Ising 
chains with periodic boundary conditions, one with a 

complete antiferromagnetic spin configuration, H-1— 

H-1-••• H-, corresponding to the highest possi¬ 

ble energy, the second one with some fraction of the 

spins flipped over, forming or-pairs, such as 

H-l-H-1-1-1- •••. In terms of domain 

walls of -I- and — boundaries, the equal sign pairs form 
elementary excitations of low energy. A microcanoni- 
cal Monte Carlo dynamics can be given by flipping spins 
whose neighbors are opposite in signs, which moves the 
domain walls around. If we put these segments together, 
it is clear that the elementary excitations will spread out 
to the whole combined system to maximize the Boltz¬ 
mann entropy. But according to DH’s definition of Sq, 
this should not preferably happen, as the system before 
and after combination has the same entropy per spin, 
ks ln2. 

The above example shows that the Gibbs entropy vi¬ 
olated Caratheodory’s formulation of second law, which 
says one cannot have an entropy function that is a con¬ 
stant in any neighborhood of an equilibrium state. It also 
invalidates Einstein theory for fluctuation. The proba¬ 
bility of certain amount of fluctuation, according to Ein¬ 
stein, is proportional to so macroscopic fluctu¬ 

ations with entropy difference of order N is extremely 
rare. But if entropy is a constant, then the fluctuations 
of the type of configurations discussed above is very com¬ 
mon, which is clearly not so. One can verify this just by 
putting the system on computer and simulate. 

We now consider the last example of computer exper¬ 
iments. Take again the ID ferromagnetic Ising chain of 
N spins with periodic boundary condition and a dynam¬ 
ics which conserves energy. We consider thermodynamic 
states and their relationship with respect to adiabatic 
changes. Here the ‘adiabaticity’ is in the sense of Lieb 
and Yngvason d, which does not implies it has to be 
slow or gentle. We begin with an equilibrium state X 
and end with another equilibrium state Y with the sole 
effect that work is done to or by the system. The ‘en¬ 
tropy principle’ states that entropy of the system must 
not decrease, S{X) < S{Y). 

We consider three thermodynamic states labelled by 
the energies E = —JN, the ground state (F), the ran¬ 
dom state E = 0 (R), and the anti-ferromagnetically 
ordered state E = +JN (A). The Gibbs en¬ 
tropies are Sg{—JN) = In2, 5 'g( 0) = ln(2^“^ -|- 
N\/{{N/2)\y‘') K. A^ln2 (assuming N/2 even), and 
Sg{+JN) = A^ln2, and accordingly the Boltzmann 
entropies are Sb{—JN) = Sb{+JN) = ln2, and 
Sb{0) = \n{N\/{{N/2)\)^) « N\n2. We have the rela¬ 
tion Sg{-JN) < Sg{0) < Sg{+JN), and Sb{-JN) = 
Sb{+JN) < Sb{0)- We now ask the following questions. 
Can we bring state F or A to R adiabatically, or can 
we bring R to F or A adiabatically? By applying the en¬ 
tropy principle, we can then judge the relative magnitude 


of entropies of these states. 

To perform an adiabatic change, we modulate the spin 
coupling J with a time-dependent protocol, J(t). Such 
changes do work to the system but no heat is transferred 
from environment to the system, since the individual de¬ 
grees of freedom Oi are not manipulated. Specifically, we 
turn J off gradually (or otherwise), and wait sufficiently 
long for the system to reequilibrate at the coupling J = 0, 
and then turn it back to J suddenly. If we start from F 
or A, it ends in R. Thus we must have S(F) < S{R), 
S'(A) < S{R). Can we take the state R and change it 
adiabatically to F or A? If we use the above protocol 
J(<), we see it is very unlikely if not impossible if N is 
finite. But in the thermodynamic limit R will remains 
in R, i.e., F to R or A to R is adiabatic irreversible, so 
S{A) < S{R). This contradicts the assignment of high¬ 
est possible Gibbs entropy to state A as thermodynamic 
entropy. 


XI. ENSEMBLE EQUIVALENCE MEANS 
THERMODYNAMICS 

The authors maintain that ensembles are generally not 
equivalent (particularly if negative T occurs for systems 
of bounded energies). If so, there would be two sets of 
thermodynamicses. Clearly, in the traditional sense of 
thermodynamics, we have only one unique one. So in 
order to be consistent with thermodynamics, different 
ensembles have to be equivalent (35j |. This happens in 
the thermodynamic limit. 


XII. ADDITIVITY OF ENTROPY VS 
POSITIVITY OF TEMPERATURE 

The authors gave up one fundamental property of ther¬ 
modynamic systems, that is, the extensivity and additiv¬ 
ity (since the thermostatistical equations are supposed to 
be valid for any size N). An example of two-state identi¬ 
cal boson system (is there such a thing in nature?) was 
shown by the authors that Sg is not additive. Why it 
is reasonable to insist on positivity of T but to break 
the additivity? Which property is more fundamental in 
thermodynamics? If we insist that additivity of entropy 
and other extensive thermodynamic variables must be 
maintained, then a single quantum oscillator system, or 
a particle in a box, for that matter, cannot be viewed 
as thermodynamic systems, as there is nothing there to 
add. The additivity is clearly needed in order to fulfill 
the zero-th law of thermodynamics. 


XIII. CONCAVITY AND SUPER-ADDITIVITY 

HHD proved 

S]i\E^^^)>SUE^) + Sl{E^). 


( 51 ) 
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This equation shows that Gibbs entropy is super-addivity 
and if the system 1 and 2 refer to the same system (but 
can be difference sizes); it is equivalent to concavity. The 
energies are conserved, +E'^. The assumption 

that internal energy is additive makes sense for macro¬ 
scopic objects, but not realistic for microscopic systems 
where the interaction is strong comparing to the energies 
themselves saparately. 

We note, firstly, that Eq. (ICTl that HHD has proved 
is generally a greater than sign ‘>’ not greater or equal 
‘>’ sign. This is so for most systems where the density of 
states are strictly positive for positive energies, such as an 
ideal gas, and also so for most of the parameters if energy 
is bounded as well. This means putting two systems to¬ 
gether always leads to a strict increase of Gibbs entropy, 
and splitting up causes a decrease of entropy. Secondly, 
this equation is not what Planck has in mind. Planck 
has been always thinking in terms of two systems and 
making them in thermal contact and then putting them 
apart (see. Sec.122-126 of Planck’s “Treatise on Thermo¬ 
dynamics” [1^). So the proper way to write Planck’s 
expression of the second law should be 

S[ + S!,>Si+ S 2 , (52) 

when the system changed from the non-prime states to 
the primed states adiabatically. Of course, Boltzmann 
entropy also has the same strictly ‘>’ sign, but if ther¬ 
modynamic limit is taken (as it can be identified with 
the thermodynamic entropy only when the size is large), 
then we will not have problem. 

Gonsider quantum two-level system (equivalent to a 
paramagnet) with energies 0 and e, respectively, of dis¬ 
tinguishable particles. E[ = = Oj 1) e > 0- 

System 1 at highest energy E^ = Ne, the Boltzmann 


entropy is, 

S'Ij = In 1 = 0, 

(53) 

and Gibbs 

^i = ln2'^. 

(54) 

taken kB = 1. 

Second system 2 at the second highest energy E^ = 
(N — l)e, one particle must be in the lower energy state, 
the rest V — 1 in high energy state. So 


Si = \nN, 

(55) 

and Gibbs 

Sl = H2^-l). 

(56) 

If we combine the two systems to get (1,2), the 
is still the second highest, E^’’^ = {2N — l)e. 
entropies of combined systems are 

energy 
So the 


Sl^ = ln(2fV), 

(57) 


and Gibbs 

= ln(2(2") - 1). (58) 

The entropy increases, are 

ASb = = In 2 > 0, (59) 

and Gibbs 

ASg = S]f - S}^ - Si = ln(l -h 1/2^) > 0. (60) 

So for both definitions, entropies increase, so “second 
law” is obeyed for both. But the actual numerical values 
are very different - Boltzmann entropy is a finite amount 
of 0.69, the Gibbs entropy extremely small for a large 
system. The temperatures are also very different (us¬ 
ing approximation T ft! SE/AS), Tb ~ —e/ln2 = 0(1), 
negative; Tq = 2^e —>■ 00 . Which one makes thermody¬ 
namic sense? 

XIV. CALLEN’S POSTULATE II 

Goncavity is a weaker condition than being entropy 
postulated by Gallen, as we cannot see why concavity 
implies Gallon’s postulate II. This postulate in terms of 
math, means 

S^’^{E) = ina^(^S^{E^) + S‘^{E - E^)y (61) 

E = E^ + E'^ is the total energy which is constrained 
between system 1 and 2, which is also the total energy of 
the combined system, (1,2). The value E^ for which the 
right-hand side obtains its maximum, E^^^, is the value 
system 1 will taken when the constraint is removed. 

A. A numerical test 

We use the same non-interacting two-level system 
model as in Sec. IXIIIl i.e., for a single particle the en¬ 
ergy is 0 in ground state and e in excited state. We set 
e = 1 for numerical convenience. The entropies are 

V 

= '" EHN-Er “ S ® S 

and 

Since e = 1, the energy E also takes integer values. 

Gonsider two systems, system 1 with particle number 
iVi, and second system 2 of identical system except the 
number of particles is N 2 = 2iVi, twice larger. We set the 
energy of the combined system (1,2) to E^’^ = |(?Vi -|- 
V 2 ). This will make the combined system with negative 
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Tb- We ask, for what value of E^, the right-hand side of 
Eq. (1611) is a maximum? This table shows the numerical 
answers: 


size Ni 

■E^max from Sb 

^^max from Sg 

% error 

5 

4 

4 

0% 

10 

8 

9 

11% 

50 

40 

43 

7.5% 

100 

80 

87 

8.7% 

500 

400 

433 

8.2% 

1000 

800 

867 

8.4% 


Clearly, when the two systems are combined with a par¬ 
ticle number 3Ni, the excitation energies should be dis¬ 
tributed evenly to the original two systems to maximising 
entropy, i.e., it should give E^^^ = (4/5)A^i, at least for 
large enough systems. The Boltzmann entropy predicted 
this down to small sizes 5 correctly, while Gibbs entropy 
always gives more energy to system 1 and less to system 
2. The right-most column in the table gives the percent¬ 
age errors made in the energy. The deviations do not 
seem to decrease as iVi goes to infinite (thus it is not 
a 1/A^ effect). Thus, we have demonstrated numerically 
that Sg violated Callen’s postulate 11. 

The locations of the maxima are associated with the 
equality of respective temperatures. An exact calculation 
can be carried out for the equilibrium values of energy 
of system 1 to be (E^) = E^'^ in the combined 

system. The heat exchange between the two subsystems, 
Q = {E^) — E^^^ = 0 if we start at the energies predicted 
by the Boltzmann entropy being largest, and Boltzmann 
temperatures being equal. 

But from HHD point of view, this violation of Callen’s 
postulate 11 is irrelevant as they rejected Callen’s formu¬ 
lation of thermodynamics. 


XV. HHD THERMODYNAMICS 

HHD proposed a thermodynamics which we express as 
the following: 

Zeroth law: temperature of the parts is 
the same as the temperature of the whole 
when in thermal contact. Note that it is for¬ 
bidden to ask what the temperatures will be 
if the parts are separated. In fact, the parts 
get different Gibbs temperatures if one does 
so. But thermodynamics alone cannot pre¬ 
dict them. 

First law: there is no dispute on this; we 
have energy conservation, dE = 5Q + 5W, 

SQ = T dS. However, even here, T and S are 
not state functions. 

Second law: entropy strictly increase 
(generically), i.e., > S'^ -I- S'^, when two 


bodies are combined. How much it increase? 
thermodynamics alone cannot tell. 

The above formulation of thermodynamics may well 
be correct for small systems, but there is very little pre¬ 
diction power it can offer. There is not much one can do 
with it. For example, the formulation has no way to tell 
us which direction heat flows if two bodies are made in 
thermal contact. There is no numerical relation of the 
entropy of the combined system (1,2) with that of sep¬ 
arated systems 1 and 2, uncoupled. One cannot analyze 
the efficiency of a Carnot engine, as the formulation does 
not have provision for the thermal coupling/decoupling 
of the system and the baths. 

The way to try to understand why thermodynamics 
has to be formulated in such a way is that the authors 
trying to fit the bill of Gibbs Sg- The Gibbs entropy does 
satisfy all the properties listed above [s^. The ‘thermo¬ 
dynamic laws’ are invented to ‘check’ that Sg satisfies 
them. Clearly, the argument is logically circular; and 
that Sg satisfies the thermodynamic laws is a misleading 
claim. 

One may argue that we are misrepresenting things, as 
the above formulation is for isolated systems. Even so, 
why it is useful at all? 

XVI. NONEQUILIBRIUM 

STATISTICAL-MECHANICAL ANALYSIS OF 

THE COUPLING/DECOUPLING PROCESSES 

We give an analysis as what happen if we couple and 
decouple two identical equilibrium systems, from statis¬ 
tical mechanics point of view and see if entropy increase 
or decrease. 

a) Consider two identical boxes of ideal gases of macro¬ 
scopic sizes with exactly the same macroscopic measur¬ 
able properties, i.e., the same thermodynamic state. If 
there is a partition separating them that can be open or 
closed, does the total entropy change? Of course not, 
according to the usual thermodynamics. In fact this is 
one of the fundamental axiom in Lieb-Yngvason’s formu¬ 
lation of thermodynamics (Ref. in page 21, axiom (A5), 
splitting and recombination). The entropy of macro¬ 
scopic observables does give zero entropy change by defi¬ 
nition [n, imi^ • This contradicts the HHD second law. 

b) Now we consider systems as small statistical me¬ 
chanical systems described by either a classical Hamil¬ 
tonian dynamics or quantum dynamics for the distribu¬ 
tions, p. Open or closing of a partition can be modeled 
by a time-dependent external potential. First of all, if 
we start with a product of microcanical distributions, 
P 1 P 2 , of two separate systems (let’s call it statistical- 
mechanical state P), it is not possible to evolve into 
a new microcanonical distribution of combined system 
(call it C), simply Liouville’s theorem prevents the value 
of probability p to be changed along the dynamic tra¬ 
jectory. Also when separating the system, it is also not 
possible to evolved back to a product state, P. The von 
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Neumann entropy is a constant in any events. So the 
question about entropy increase or decrease cannot be 
answered in such a framework. 

In order to have a Boltzmann-like H-theorem, one need 
to use a coarse-grained description , which 

essentially lead to: 

c) a third option, a stochastic dynamics of Markov 
chain. In this framework the problem is well-posed. In 
such a description, we can make transitions from P to C 
dynamically which lead to an entropy increase. Still C to 
P is not possible. If we start from the combined system 
C in a microcanonical distribution, the probability dis¬ 
tribution ends up to a distribution of energy partitions 
of the product microcanonical distributions, let us call 
this state D, the decoupled but still entangled state, so 
C^D. 

To think of this with a concrete example, we can still 
take the paramagnet or equivalently the two-level sys¬ 
tem, with energy e in the excited state and 0 for the 
ground for each particle. To give a meaning to spatial lo¬ 
cality and partition, we imagine that the spins/particles 
form a ID chain. The dynamics is simply to pick two 
nearest neighbor particles at random and swap the loca¬ 
tions. This is an energy (and magnetization) conserving 
process. Let us consider two identical systems with N 
particles each and one excited particle each with total 
energy E = e. The entropy increases when two systems 
are combined are, ASb = Sb{C) — Sb{P) — ln(2 — 1/A^), 
and ASc = ln[(2A^^ -|- -|- I)/(A^ -|- I)^], respectively. 

For both definitions of entropy, the increase approaches 
In 2 for sufficiently large N. 

If we split the system from state C by adding parti¬ 
tion, it evolves towards D. It is not clear at all how to 
quantify the entropy. We give four possibilities: (i) we 
know exactly what the energies are of each subsystems 

— such is the case if we simulate the process on com¬ 
puter, and check exactly how many excited particles are 
in one of the partitions. Then total entropy decreases, 
(ii) If we are not allowed to measure the energy or our 
measurement is not precise, the total entropy still de¬ 
creases. For example, the total entropy may be defined 
by S'ii(D) = J2jPji^j + where pj is the probability 
that subsystem 1 get an energy Ej which can be calcu¬ 
lated from the initial microcanonical distribution of sys¬ 
tem C. Then, (hi), we can apply the Shannon entropy, 

— ^plnp = — (Inp), over the whole state space. Since 
the probability of a particular microscopic configuration 
is the probability pj of getting split into energy Ej , times 
the probability in a particular microscopic state of the 
joint system, which is equal probable in each subsystem, 
we can write, 

5'iii(D) = SBAiiD) + {-'^Pj Inpj}. (64) 

3 

This is higher comparing to case (ii) by an amount due 
to the random selection of energies. For the two par¬ 
ticles in a ID box of size 2N problem, one finds that 
Siii{D) — Sb{C) = 0 (this is a general result), and 


Siii{D) — Sg{C) < 0, i.e., entropy does not change 
if Boltzmann entropy for state C is used and entropy 
still decreases if Gibbs entropy is used. Curiously, C 
to D is a reversible process or recoverable - removing 
the parition will make the system back to C, so en¬ 
tropy does not change make good sense, (iv) In the 
last case we can consider the expression given by [13, IHl 
PihiQ,{Ei) = (luD), where Ei is the energy of the 
system in micro-state i with probability pi. With the 
microcanonical constraint, all states have the same en¬ 
ergy, so it is a constant with the value Sg{C)] entropy 
does not change. Unfortunately, it is a constant no mat¬ 
ter what initial distributions to begin with. So, it cannot 
describe relaxation towards equilibrium. 

To conclude, if we believe that the opening or closing 
a partition is an adiabatic process (possibly performing 
work but no heat exchange), then entropy must not de¬ 
crease. Cases (i)-(iv) show that Gibbs entropy contra¬ 
dicts Planck’s formulation of the second law, or at least, 
Gibbs entropy cannot make any definite statement as it 
is not properly defined for state D. The fact that we 
cannot have unambiguous interpretation of entropy in a 
state D only demonstrates that thermodynamic entropy 
is a macroscopic concept. The contradictions and ambi¬ 
guity disappear for large systems. 


XVII. NON-MONOTONIC DEPENDENCE OF T 
WITH ENERGY E 

HHD cited reasons not to use temperature Tg or Tg to 
judge if heat can flow from one body to another or not. 
Both of them fail to do so for tiny systems. The reason 
for this failure is because they insists that thermodynam¬ 
ics works for any size N. If one consider only thermo¬ 
dynamic limit result (in the sense of omitting any con¬ 
tributions smaller than N for extensive quantities such 
as energy and entropy, and omitting quantities of order 
1/iV or \og{N)/N for intensive quantities such as tem¬ 
perature), thermodynamics works just fine. Both zeroth 
and second law can be satisfied which define the thermo¬ 
dynamic system. 

The internal energy U is a monotonic function of —/3 
for large systems, so increasing temperature always lead 
to an increase of the internal energy. This can be seen 
easily in the canonical ensemble, since in the canonical 
ensemble the heat capacity measures the fluctuation of 
the energy, 

which is always positive, and one can verify that the heat 
capacity is always a positive quantity, even for the nega¬ 
tive Boltzmann temperature states. 
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XVIII. WHY INSISTS ON Sg? 

By postulate Sg as the thermodynamic entropy, we got 
1) positivity of T (but why this is important), 2) concav¬ 
ity and super-additivity of Sg- But breaks many things: 
1’) ensembles no longer equivalent, even for a paramag- 
net, 2’) temperatures of individual systems and combined 
system are not the same, and violating the usual 0-th law 
of thermodynamics. 3’) Violation of Callen’s postulate II. 
4’) meaningless thermodynamics when Tb < 0, which are 
Tg = 00 , Sg = const, heat capacity (7 = 0. One cannot 
write down a meaningful thermodynamic relation as it is 
oo • 0. 5’) thermodynamics losses its predicting power in 
the sense of Callen’s postulate II since Sg is a constant. 
In addition, when applied to single quantum degree sys¬ 
tems (we believe one cannot do that for both Sb and 
Sg), one violates 6’) third law of thermodynamics. 

HHD’s deduction has a logic fallacy: thermodynamic 
entropy must satisfy zeroth, first, and second law. Gibbs 
volume entropy does not satisfy HHD’s version of zeroth 
law (average temperatures of subsystems when in ther¬ 
mal contact equal the temperature as a whole), when 
energy of the system is bounded. Therefore, there is 
no logical implication that thermodynamic temperature 
cannot be negative. 


XIX. FINAL REMARK 

If canonical ensemble were used to treat the harmonic 
oscillator, an explicit thermodynamic limit is not neces¬ 
sary as the free energy is already a homogeneous func¬ 
tion of particle number even for one and two particles. 
It is clear we are already in the “thermodynamic limit”; 
the specific one calculated for one particle in a canonical 
ensemble is just one of the many. However, in the mi- 
crocanonical ensemble, situation is different and taking 
the limit is a necessary step in order to have an entropy 
expression that is consistent with thermodynamics. 
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